Cryptic female choice is a potentially important aspect of the sexual selection process. According to the theory of sexual dialectics, postcopulation manipulation of relative male fertilization success can provide an avenue by which females can circumvent attempts by males to control female reproduction. Here I use stochastic models to investigate the evolution of cryptic female choice in populations with and without age structure. In populations without age structure, cryptic female choice will evolve only when (1) precopulatory mate choice by females is inefficient, (2) variation in male fitness is correlated with a trait upon which a female can base her choice of mates, and (3) the cost of multiple mating is not too high. In populations with age structure, similar conditions apply. However, selection sometimes favors females that employ alternative strategies of female choice at different ages. These results help to define the types of biological systems in which we should expect to see the evolution of cryptic female choice. They also illustrate that the evolution of choice strategies in females may be complex and may mirror in some important respects the evolution of alternative mating tactics in males.